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Abstract 

Exact formulas for classical error variance are provided for Rasch measurement with logistic 
distributions. An approximation formula with the normal ability distribution is also provided. 
With the proposed formulas, the additive contribution of individual items to the population error 
variance can be determined without knowledge of the other test items. This feature, not available 
with previous treatments of classical error variance, may have useful applications in test analysis 
and development. Formulas for the population true score of individual items are also provided 
for logistic and normal ability distributions. Thus, from a bank of Rasch calibrated items, one can 
select items to develop a test with a prespecified (a) standard error of measurement, (b) mean true 
score, or (c) error- to-true score ratio for a target population of examinees. These parameters can 
be used also in comparing subsets of test items that are grouped by substantive or measurement 
characteristics (e.g., content areas or strands of learning outcomes in proficiency testing). 
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Error Variance of Rasch Measurement with Logistic Ability Distributions 

In item response theory (IRT), the accuracy of measurement with a test varies across the 
levels of a latent trait (ability), 0, that determines the chances for success on any item in the test. 

A 

The IRT error variance at a specific 0, Var(0|0), is inversely related to the information provided 

by the test at 0 (Bimbaum, 1968). This error variance indicates the precision with which ability is 

estimated at the 0 level and is not to be confused with the raw-score variance at 0, Var(x|0). In 

fact, averaging Var(x|0) over the 0 values for a population of examinees yields the classical error 

/\ 

variance for this population, a I , whereas averaging Var(0|0) results in the so-called marginal 
error variance, (T*. (Green, Bock, Humphreys, Linn, & Rechase, 1984; Thissen, 1990). While 
the classical error variance relates to the classical reliability, p xx = 1 - cr? / a l, the marginal 
error variance relates to a marginal reliability : p = l— /Cg (Thissen, 1990, p. 167). 

In computerized adaptive testing (CAT), for example, the marginal error variance is used 
with the stopping rule according to which "all examinees are tested to the same value of the error 
variance over as wide a range of ability as practical" (Green et al., 1984, p. 352). Thissen (1990) 
noted that "marginal reliabilities provide the only comparison between the internal-consistency 
reliability of a CAT and previously or alternatively used paper-and-pencil forms, for which only 
classical reliability estimates are available" (p. 167). Such comparisons require quality estimates 
of the classical error variance for a population of examinees. Moreover, classical error variance 
and reliability estimates are still widely used in substantive and measurement studies even when 
IRT information is available (e.g., with standardized tests). 

Under classical test theory, the reliability is defined as the ratio of true score variance to 
observed score variance (p xx = o \ / 0 x ). Although the reliability coefficient is a convenient 

unitless number between 0 and 1 , the classical error variance and its square root (standard error 
of measurement, SEM) relate to the meaning of the scale and are, therefore, more useful for score 
interpretations (e.g., Feldt & Brennan, 1989; Thissen, 1990). However, there are methodological 

and accuracy problems with the classical formula for error variance, Oj = a x (l-p xx ). In 
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practical applications of this formula, a \ is replaced with its sample estimate for the data at hand 



and p xx is replaced with the Cronbach’s alpha (Cronbach, 195 1) or other not sufficiently accurate 
coefficients. As a reminder, the Cronbach’s alpha may underestimate p xx (when the components 
of the test are not at least essentially tau-equi valent; Novick & Lewis, 1967) or overestimate 
(when there are correlated errors; Komaroff, 1997). Moreover, while the definition of reliability, 
p xx , requires (explicitly or implicitly) information about the error variance, the error variance (as 

is shown later in this paper) can be defined and calculated without information about CT x or p xx . 

The purpose of this paper is to propose formulas for independent additive contributions of 
individual items to classical error variance and true scores using item difficulty estimates with 
the dichotomous Rasch measurement model (RM) (Rasch, 1960). It should be noted that the 
approach in this paper uses RM information to deal with accuracy of measurement in the original 
(number-right score) scale and is not to be confused with Rasch measurement methods that deal 
with accuracy of ability scores on the logit scale (e.g., Smith, Jr., 2001; Wright & Stone, 1979). 



For dichotomously scored items, Lord (1980, p. 52) presented the error variance for a test 
of n items as the mean of the conditional error variances for the number-right scores at the ability 
estimates of N examinees, 0,, ..., 0 N : 



where P;(0j) is the probability for correct answer on item i from an examinee with ability 0j and 
the product P;(0j)[l - Pj(0j)] is the conditional error variance for item i at 0j. The error variance in 
(1) is based on discrete ability values, 0„ ..., 0 N , for the sample. The population error variance is 
obtained by replacing the summation in Equation 1 for integration over the ability interval: 



Theoretical Framework 




( 1 ) 
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where cp(0) is the probability density function (pdf) for the ability. The additive contribution of 
the ith test item to the classical error variance in Equation 2 is referred to here as error variance 

component, a ei , for this item: 

°= i = J£ p i(e)[i- p i(e)]d 0 <?) 



It is important to note that the additive contribution of individual items to the classical 
error variance, a \ , can be determined without knowledge of the other test items. This feature, 

not available with traditional treatments of classical error variance, can be practically useful in 
test development and analysis. For example, given set of Rasch calibrated items, one can select 
items to develop a test with prespecified standard error of measurement (SEM) that relates the 
test to specific ability distributions (e.g., logistic, normal, or triangular). 

Previous research provides very limited (approximation-based) applications of Equation 2 
mostly because of technical difficulties with the integral evaluations. Such evaluations can be 
performed, for example, by Gaussian quadrature (Bock & Lieberman, 1970), but exact formulas 
are either difficult or not possible to derive with the <p(0) for most practically occurring ability 
distributions. May & Nicewander (1993) used Equation 2, approximating compound binomial 
conditional distributions of raw scores, with the purpose to compare reliability for number-right 
scores and percentile ranks with the 3-parameter logistic model for normal and triangular ability 
distributions. 

This paper provides formulas for independent additive contributions of individual items 
to the classical error variance and true scores as a function of item difficulty estimates with the 
RM for logistic and normal ability distributions. With the dichotomous RM, 




Pi(6) = 



e e-b ' 

1 + e e_b ' 
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where b, is the difficulty parameter of item i. Also, the product Pi(0)[l - P;(0)] equals the first 
derivative of P,(0): 

e 0_bi 

Pi (9)[1 - P; (0)] = (1 + e e- bi yf ( 5 ) 

Thus, the error variance component in Equation 3 can be written as 

cr^ = } a P [5Pi (0) / 50](p(0)d0 = j P <p(6)dP i (0) (6) 

The next sections provide exact formulas for the classical error variance components, cr*. , when 

Pj(0) is with the dichotomous RM and (p(0) is the pdf for logistic and normal distributions. 

Error Variance Components for Logistic Ability Distribution 

The pdfoi a logistic distribution (e.g., Evans, Hastings, & Peacock, 1993, p. 98) with the 
location at the origin of the scale is 

exp(9 / c) 



(p(0) = 



c[l + exp(0 / c)]' 



(7) 



where c is the scale parameter. Figure 1 shows the pdf of logistic distributions with c = 1/2 and 1. 
These two specific logistic shapes were selected because (a) their logistic pdfs, lead to exact 
integral evaluations for error variance components and (b) the shapes that they produce capture 
normal-like ability distributions that may practically occur with Rasch measurement. 

As one may also notice, cp(0) in Equation 7 is the first derivative of the function 

exp(0 / c) 



0 ( 0 ) = 



1 + exp(0 / c) 



Thus, replacing (p(0) in Equation 5 with the first derivative of 0(0), we have 



O 

ERIC 



cl = f [dp,(0)/d0][do(0)/de]de= f [ap i (6)/ae]do(0) 
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Then, with integration by parts and simple calculations, we have 

°l, = [3Pi(e)/ae]4>(8)|" - £<t>(e)d[ap i (8)/ae] 



= 0 - 




o(e)[a 2 Pi (e)/ae 2 ]de 



r° ex P(6 / C) exp(0 - bj )[1 - exp(9 - b>j )] 
•Lo [1 + exp(0 / c)][l + exp(0 - bj)] 3 



Let us denote E = e 1 . Using the substitution rule for integration with x = exp(0), we have 






EiX 1 /c (x-Ei) 

(l + x 1 /c )(x+ Ej)' 



dx 



( 8 ) 



The evaluations of the integral in Equation 8 for c = 1 and c = 1/2, respectively, are: 
1. With c = 1 , 



<7 



2 

ei 



E, (b,Ej - 2E; + b; + 2) 
(E; - 1) 3 



(9) 



When b x = 0, the denominator of the ratio in Formula 9 equals zero. In this case, calculating the 
the limit of the ratio at b f = 0, we have: a ^ = 0. 1667 (see Table 1). 

2. With c= 1/2, 



E, [8(1 - bj )E? + 8(bj + l)Ej + TtEf - 6uE]. + n] 
2(Ef + 1) 3 




( 10 ) 
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The integral evaluations in Formulas 9 and 10 were verified using MATLAB 5.3 (MathWorks, 
Inc., 1 999). Thus, when the ability scores follow a logistic distribution located at the origin of the 
scale with a scale parameter c = 1 or 1/2, the error variance components for individual items can 
be calculated with Formulas 9 or 10, respectively. Values of error variance components, a * , are 



tabulated in Table 1 and graphed in Figure 2. Since a], (-b ; ) = a* (b ; ),one can use Table 1 for 



any set of Rasch calibrated items, with b - t ranging from -8 to 8. For example, the error variance 
component at bj = 1 for the logistic pdf with c = 1 (0. 1509 ) equals the error variance component at 
b, = - 1 for the same pdf 

Error Variance Components for Normal Ability Distribution 

With cp(0) for the standard normal pdf the integral for the error variance component in 
Equation 6 can be written as 



/•CO 

*- 0 c 



exp(0 - bj) 



-oo [l + exp(0 - bj )] 2 ^ 



■exp(-.50 



d0 



(ID 



Since a closed form evaluation of the integral in Equation 1 1 does not exist, an approximation 
formula for was developed in two steps. First, using the computer program MATLAB 5.3 

(MathWorks, Inc., 1999), quadrature method evaluations of the integrals fora g. were obtained. 

The results are tabulated in Table 2 and graphed in Figure 3. Second, it .was found that the values 
of a fit the following approximation: 

Og. = A+ i?exp[-0.5(6j / C) 2 ], (12) 

where: 

(a) ^ = 0.011, B = 0.195, and C= 1.797, if |6J < 4, or 

(b) v4 = 0.0023, B = 0.171, and C = 2.023, if * 4. 
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Note that a 2 is an even function of the Rasch item difficulty, i.e., G e; (~b \ ) = G (b x ). Thus, 

one can use Table 2 for items with Rasch difficulty that range in from -6 to 6 on the logit scale. 
The absolute error of approximation with Formula 12, |e|, ranges from 0 to 0.0008, with a mean of 

0.00021 and a standard deviation of 0.00017. Also, the approximation errors, s, practically do not 
affect the total classical error variance because they vary in sign (see Table 2) and cancel out to a 
large degree in summing error variance components. One can use Formula 12 with any normal 
ability distribution, N(p 0 ; a 9 ), after appropriate transformation of the Rasch item difficulties for 

the test: b* = (bj - p 0 ) / G 0 (e.g., Lord, 1980). 

Item True Score as a Function of Rasch Item Difficulty 

In this section, the expected true score for individual items, Xj, is represented as a function 
of their Rasch difficulty with the normal and logistic ability distributions (c = 1 and 1/2): 



Ti = }_ oo x i |e9(0)d0 = }_ oo P i (0)(p(0)d0, (13) 

where P ; (0) is with the dichotomous Rasch measurement model and (p(0) is the ability pdf. Then, 

the total true score for a test of n items is: x = ^ " Xj ; ( the average true score is x = x / n ). 

Logistic Ability Distribution (scale parameter c = 1) 

In this case, (p(0) in Equation 13 is substituted for its expression (with c = 1) in Equation 7: 







exp(0 - b|)exp(0) 

[1 + exp(0 - b; )] [1 + exp(0)] 2 



d0 



(14) 



Using the integral substitution t = exp(0), the evaluation of the integral in Equation 14 becomes 
straightforward and leads to the formula for the item true score in this case: 



_ (bj ~ l)exp(bj) + 1 
[exp(bj) - 1] 2 



(15) 
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Logistic Ability Distribution (scale parameter c = 1/2) 

Now, (p(0) in Equation 13 is substituted for its expression (with c = 1/2) in Equation 7: 







2 exp(0 - b | ) exp(20) 

[1 + exp(0 - b j )] [1 + exp(20)] 2 



d0 



(16) 



Again, using the substitution t = exp(0), we obtain the following formula: 



7 texp(b i )[exp( 2 b i )- l]-2(2bj - l)exp(2bj) + 2 
X| 2[1 + exp(2b;)] 2 ' 

Normal Ability Distribution 

When q>(0) is the pdf of the standard normal distribution, there is no closed form for the 
integral evaluation in Equation 13. Using the quadrature method of integration with the computer 
program MATLAB (Math Works, Inc, 1 999), the following approximation formula was developed 
for the true, score of individual items in this case: 



*1 



-0.0114 + 



1.0228 

1 + exp(Z> ; / 1.226) 



(18) 



with an absolute error smaller than 0.002. 

It should be noted also that Formulas 17 and 18 produce almost equal true scores for the 
same value of b { (with an absolute difference smaller than 0.008). This is graphically represented 
in Figure 5 where the item true score curves produced by Formulas 17 and 18 overlap. One can 
use Formula 1 8 with any normal distribution, N(p„; o 0 ), after the appropriate transformation of the 

item difficulty estimates b\ = (b t - ft 0 ) / a 0 (e.g., Lord, 1980). 

The proposed formulas for trues scores of individual items can be useful in theoretical and 
practical (e.g., simulation) studies or developing computer software for Rasch measurement. Also, 
given a set of n items, one can calculate the ratio a e / X , where a e = a e / n and T = T In. 
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This unitless ratio, referred to here as error-to-true score ratio (ETR), can be useful in comparing 
magnitudes of measurement error across different scale units. Thus, one can control the values of 
a e , x, and ETR for a set of Rasch calibrated items or compare such values for different subsets of 
items grouped by some substantive or measurement characteristics (e.g, content area or strands of 
learning outcomes). 

Example 

This example illustrates the calculation of error variance components and true scores for 
Rasch calibrated items with the normal ability distribution. Data were collected with the Ohio 
Off-Grade Proficiency Test-Mathematics (Riverside Publishing, 1995) for 2547 fifth graders 
from a large urban area in northeastern Ohio. Using RASCAL (Assessment System Corporation, 
1995), it was found that the data fit the Rasch model with 20 dichotomous items and the ability 
scores (in logits) followed the standard normal distribution. The item difficulty estimates, b h 
error variance components (calculated with Formula 12), and true scores (calculated with 
Formula 18) are provided in Table 3. The standard errors of the estimated item difficulties, b„ 
ranged from 0.04 to 0.06. In Table 3, the items are grouped by their content area: Algebra (nine 
items), Geometry (four items), and Data Analysis/Probability (six items). The sum of all 20 error 

variance components in Table 3 is the classical error variance for the test:<je = 3.675. Thus, the 

standard error of measurement for the population with this test: SEM = V 3.675 = 1.917. 

Figure 4 presents the intervals t 0 ± SEM and x 9 ± o e | 0 , where x 9 is the true score for the 
20-item test at the ability level 0 and o e | 0 is the conditional error variance for the test score at 0. 
Evidently, the SEM bounds are slightly off the conditional ones at either very low or very high 
ability levels thus providing a good overall estimation of the error associated with the raw scores 
on the test. Table 4 provides, by content areas, the values of o e , x , and their ratio, ETR. As one 

can see, the students are most successful on the algebra items ( x = .534 ) and least successful on 
the data analysis/probability items ( x = .442 ). The lowest error of measurement per item is 
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associated with the algebra items (0.146) and the highest, with the geometry items (0.187). The 
lowest relative error of measurement (0.273) is associated with the algebra items and the highest 
(0.389), with the data analysis/probability items. For the whole test, the error of measurement is 
relatively small compared to the true score (ETR = 0.191). 

Conclusion 

This paper provides formulas for independent additive contributions of items to the 
classical error variance and true scores with Rasch measurement for logistic and normal ability 
distributions. The proposed formulas deal with expected values of classical measurement error 
and true scores for a population with specified ability distribution and do not require information 
about specific ability scores for a sample of examinees. The method used in this paper eliminates 
methodological and accuracy problems related to traditional methods based on Cronbach’s alpha 
or other not sufficiently accurate classical coefficients. Also, it uses RM calibration of items to 
evaluate the accuracy of number-right scores but is not be confused with Rasch measurement 
methods that deal with accuracy of ability scores on the logit scale (e.g., Smith, Jr., 2001 ; Wright 
& Stone, 1979). 

The logistic ability distribution used in this study is located in the origin of the scale, with 
a scale parameter of 1 and 1/2, respectively. These two specific values relate to bell-shaped 
ability curves that may practically occur in measurement situations and, most importantly, yield 
exact integral evaluations in the derived formulas for classical error variance (see Formulas 9 and 
10). This is not true with just any scale parameter of the logistic distribution. 

Formula 12 generates error variance components of individual items with the standard 
normal ability distribution. It can be used with any normal ability distribution after standardizing 
the ability scores and then using the same linear transformation for the Rasch item difficulty 
estimates. The absolute error of approximation with Formula 12 varies from 0 to 0.0008, with a 
mean of 0.00021 and a standard deviation of 0.00017. Also, the approximation errors practically 
do not affect the total classical error variance because they vary in (positive/negative) sign (see 
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Table 2) thus canceling out to a large degree in the summation of error variance components. 

With the proposed formulas, given the RM calibration of items, one can evaluate the 
classical error variance and SEM for a population without further data collection. The additive 
contribution of each item to the classical error variance can be determined without knowledge of 
the other items in the test. This feature, not available with previous treatments of classical error 
variance, can be very useful in test development and analysis. For example, from a bank of items 
calibrated with the dichotomous RM, one can select items to develop a test with a desirable error 
variance. One can use the tabulations in Tables 1 and Table 2 or perform calculations with the 
appropriate formula using basic statistical programs, spreadsheet programs, or even calculators. 

It should be noted that skewed ability distributions also occur with Rasch measurement 
(e.g., in medical studies; Wright, 2000). Dimitrov (2000) provided exact formulas for error 
variance components with skewed (e.g. triangular and pseudo-lognormal) ability distributions 
with Rasch measurement. 

Formulas 15, 17, and 1 8 provide the true score of individual items as a function of their 
Rasch item difficulty for two logistic ability distributions (with scale parameters c = 1 and 1/2) 
and the standard normal ability distribution, respectively. Thus, given a bank of Rasch calibrated 
items, one can control the error of measurement, true score, and error-to-true score ratio for any 
set of items. One can also compare measurement errors and trues scores for different subsets of 
test items that are grouped by substantive or measurement characteristics (e.g., content area and 
strands of learning outcomes). 

In conclusion, using Rasch measurement information for the evaluation of independent 
and additive contribution of individual items to classical error variance and true scores provides 
high quality in understanding, calculating, and reporting classical error of measurement. 
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Table 1 

Error Variance Components (a].) as a function of Rasch Item 
Difficulty (b) for Logistic Ability Distributions with c = 1 and c = 1/2 





Scale parameter 


b i 


Scale parameter 


C = 1 


C — 1/2 


C = 1 


C — 1/2 


0 


.1667 


.2146 


4.1 


,0384 


.0226 


.1 


.1665 


.2142 


4.2 


.0360 


,0206 


.2 


.1660 


.2131 


4.3 


.0337 


.0189 


.3 


.1652 


.2113 


4.4 


.0316 


.0172 


.4 


.1640 


.2089 


4.5 


.0295 


.0157 


.5 


.1626 


.2057 


4.6 


.0276 


.0143 


.6 


.1608 


.2019 


4.7 


.0258 


.0131 


.7 


.1587 


.1976 


4.8 


.0241 


.0119 


.8 


.1564 


.1927 


4.9 


.0225 


.0108 


.9 


.1538 


.1874 


5.0 


.0210 


.0099 


1.0 


.1509 


.1816 


5.1 


.0195 


.0090 


1.1 


.1479 


.1755 


5.2 


.0182 


.0082 


1.2 


.1446 


.1690 


5.3 


.0169 


.0074 


1.3 


.1411 


.1624 


5.4 


.0157 


.0067 


1.4 


.1375 


.1555 


5.5 


.0146 


.0061 


1.5 


.1337 


.1486 


5.6 


.0136 


.0056 


1.6 


.1298 


.1415 


5.7 


.0126 


.0050 


1.7 


.1258 


.1345 


5.8 


.0117 


.0046 


1.8 


.1217 


.1275 


5.9 


.0108 


.0042 


1.9 


.1175 


.1205 


6.0 


.0100 


.0038 


2.0 


.1133 


.1137 


6.1 


.0093 


.0034 


2.1 


.1091 


.1070 


6.2 


.0086 


.0031 


2.2 


.1049 


.1005 


6.3 


.0080 


.0028 


2.3 


.1006 


.0942 


6.4 


.0074 


.0026 


2.4 


.0964 


.0881 


6.5 


.0068 


.0023 


2.5 


.0923 


.0823 


6.6 


.0063 


.0021 


2.6 


.0882 


.0767 


6.7 


.0058 


.0019 


2.7 


.0841 


.0713 


6.8 


.0054 


.0017 


2.8 


.0801 


.0662 


6.9 


.0050 


.0016 


2.9 


.0763 


.0614 


7.0 


.0046 


.0014 


3.0 ^ 


.0725 


.0569 


7.1 


.0042 


.0013 


3.1 


.0688 


.0526 


7.2 


.0039 


.0012 


3.2 


.0652 


.0486 


7.3 


.0036 


.0010 


3.3 


.0617 


.0448 


7.4 


.0033 


.0010 


3.4 


.0584 


.0413 


7.5 


.0030 


.0009 


3.5 


.0552 


.0380 


7.6 


.0028 


.0008 


3.6 


.0520 


.0349 


7.7 


.0026 


.0007 


3.7 


.0491 


.0320 


7.8 


.0024 


.0006 


3.8 


.0462 


.0294 


7.9 


.0022 


.0006 


3.9 


.0435 


.0269 


8.0 


.0020 


.0005 


4.0 


.0408 


.0247 









Note. For negative b h one can use that a ]. (- b , ) - a ^ ( b • ) . 
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Table 2 

Error variance components (<7 g. ) and their approximations (c e j ) 
with formula (13 ) as a function ofRasch item difficulty (bf 



b i 


a g. 

e L 


- 2 
a ei 


8 


b i 


a 

e i 


- 2 
(5 

e i 


8 


0.0 


.2066 


.2060 


.0006 


3.1 


.0554 


.0550 


.0004 


0.1 


.2063 


.2057 


.0006 


3.2 


.0513 


.0509 


.0004 


0.2 


.2054 


.2048 


.0006 


3.3 


.0474 


.0471 


.0003 


0.3 


.2038 


.2033 


.0005 


3.4 


.0437 


.0436 


.0002 


0.4 


.2017 


.2012 


.0005 


3.5 


.0403 


.0403 


.0000 


0.5 


.1990 


.1986 


.0004 


3.6 


.0371 


mu 


-.0001 


0.6 


.1957 


.1954 


.0003 


3.7 


.0341 


.0344 


-.0003 


0.7 


.1920 


.1918 


.0002 


3.8 


.0313 


.0318 


-.0006 


0.8 


.1877 


.1876 


.0001 


3.9 


.0287 


.0295 


-.0008 


0.9 


.1830 


.1830 


.0000 


4.0 


.0263 


.0265 


-.0002 


1.0 


.1779 


.1780 


-.0001 


4.1 


.0241 


.0242 


-.0002 


1.1 


.1725 


.1727 


-.0002 


4.2 


.0220 


.0221 


-.0001 


1.2 


.1668 


.1670 


-.0002 


4.3 


.0201 


.0202 


-.0000 


1.3 


.1608 


.1611 


-.0003 


4.4 


.0184 


.0184 


.0000 


1.4 


.1546 


.1550 


-.0003 


4.5 


.0168 


.0167 


.0001 


1.5 


.1483 


.1486 


-.0004 


4.6 


.0153 


.0152 


.0001 


1.6 


.1418 


.1422 


-.0004 


4.7 


.0139 


.0138 


.0001 


1.7 


.1353 


.1357 


-.0004 


4.8 


.0127 


.0125 


.0001 


1.8 


.1288 


.1291 


-.0003 


4.9 


.0115 


.0114 


.0001 


1.9 


.1222 


.1225 


-.0003 


5.0 


.0105 


.0104 


.0001 


2.0 


.1158 


.1160 


-.0002 


5.1 


.0096 


.0094 


.0001 


2.1 


.1094 


.1095 


-.0001 


5.2 


.0087 


.0086 


.0001 


2.2 


.1031 


.1032 


-.0001 


5.3 


.0079 


.0078 


.0001 


2.3 


.0970 


.0970 


.0000 


5.4 


.0072 


.0072 


.0000 


2.4 


.0911 


.0909 


.0001 


5.5 


.0065 


.0065 


-.0000 


2.5 


.0853 


.0851 


.0002 


5.6 


.0059 


.0060 


-.0001 


2.6 


.0797 


.0795 


.0003 


5.7 


.0054 


.0055 


-.0002 


2.7 


.0744 


.0741 


.0003 


5.8 


.0049 


.0051 


-.0002 


2.8 


.0693 


.0689 


.0004 


5.9 


.0044 


.0047 


-.0003 


2.9 


.0644 


.0640 


.0004 


6.0 


.0040 


.0044 


-.0004 


3.0 


.0598 


.0594 


.0004 











Note. 8 = C gj - 6 gj ; For negative b„ use a (- b \ ) - Ct e; (A )• 
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Table 3 

Error Variance Components, o , and 

true scores, x i; for the Rasch Calibrated 
Items of the Example Mathematics Test 
Grouped by Content Areas 



Item 


b i 


a e, 






Algebra 




2 


-0.659 


0.1933 


.634 


3 


-0 . 988 


0 . 1786 


.696 


4 


0 . 600 


0 .1954 


.377 


8 


-0.648 


0 .1937 


. 632 


9 


-0 . 101 


0 . 2057 


. 521 


10 


1.085 


0 . 1735 


.287 


15 


0 . 266 


0.2039 


. 445 


16 


-0 . 792 


0 . 1880 


.660 


17 


-0 . 246 


0.2042 


. 551 




Geometry 




1 


-1.563 


0 . 1446 


. 788 


6 


0 . 969 


0 . 1796 


.309 


14 


-0.354 


0.2023 


. 573 


19 


-0 . 886 


0 . 1837 


. 677 


20 


1 . 241 


0 . 1646 


.261 


Data 


analysis /Probability 


5 


-0 . 275 


0.2037 


. 557 


7 


-1.119 


0 . 1716 


. 718 


11 


1 . 044 


0.1757 


.294 


12 


2.180 


0 . 1044 


.136 


13 


0.315 


0.2030 


.435 


18 


-0 . 069 


0.2059 


. 514 



Note . The classical error variance for 



20 

the test is CS l = £ =3.6754. 

i=1 
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Table 4 

Mean SEMper Item ( a s ), True Score (1 ), and Their Ratio 
by Content Areas of the Mathematics Test 



Content area 


n 




X 


a e /x 


Algebra 


9 


0.146 


.534 


0.273 


Geometry 


5 


0.187 


.521 


0.359 


Data analysis/Probability 


6 


0.172 


.442 


0.389 


Total test 


20 


0.096 


.503 


0.191 



Note, n = number of items; 
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Figure 1 . Probability density functions (PDF) 
of the standard normal distribution and two 
logistic distributions with scale parameters 
c = 1 and c = 1/2. 
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Figure 2. Error variance components, a ^ , as a function of 

Rasch item difficulty for logistic ability distributions with 
scale parameters c = 1 and c— 1/2. 
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Rasch item difficulty (in logits) 



Figure 3. Error variance components, a e[ , as a function of 
Rasch item difficulty for the standard normal ability distribution 
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Figure 4. Boundaries for measurement error about conditional 
true scores, x 0 , for the 20-item mathematics test: i 0 ± SEM (dashed 
lines, --) and x 9 ± c e | 9 (maker lines, +) ; (in this case, SEM = 1.917). 
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Figure 5. Item true score as a function of Rasch item 
difficulty when the population ability distribution is normal 
(solid line), logistic with c = 1 (dotted line, and logistic with 
c = 1/2 (dashed line — superimposed on the solid line) 
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